Training Asynchronous Input/Output Hidden Markov Models
نویسندگان
چکیده
In learning tasks in which input sequences are mapped to output sequences, it is often the case that the input and output sequences are not synchronous. For example, in speech recognition , acoustic sequences are longer than phoneme sequences. Input/Output Hidden Markov Models have already been proposed to represent the distribution of an output sequence given an input sequence of the same length. We extend here this model to the case of asynchronous sequences, and show an Expectation-Maximization algorithm for training such models .
منابع مشابه
An Asynchronous Hidden Markov Model for Audio-Visual Speech Recognition
This paper presents a novel Hidden Markov Model architecture to model the joint probability of pairs of asynchronous sequences describing the same event. It is based on two other Markovian models, namely Asynchronous Input/Output Hidden Markov Models and Pair Hidden Markov Models. An EM algorithm to train the model is presented, as well as a Viterbi decoder that can be used to obtain the optima...
متن کاملUsing Input-Output Hidden Markov Models for the Aggregation of Performance Models
This paper describes a new idea how to use InputOutput Hidden Markov Models (IOHMMs) for the aggregation of performance models and reports about corresponding first experiments. The parameters of the IOHMM are calculated from observation sequences obtained from the input/output behaviour of the original model.
متن کاملInput-Output Hidden Markov Models for the Aggregation of Performance Models
— This paper reports about experiments on generating aggregates for performance (sub)models. The aggregates are described by Input-Output Hidden Markov Models (IOHMMs). The parameters of the IOHMM are calculated from observation sequences obtained from the in-put/output behaviour of the original (sub)model.
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملAn Input Output HMM
We introduce a recurrent architecture having a modular structure and we formulate a training procedure based on the EM algorithm. The resulting model has similarities to hidden Markov models, but supports recurrent networks processing style and allows to exploit the supervised learning paradigm while using maximum likelihood estimation.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1996